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[57] 



ABSTRACT 



A method for testing a web site includes formulating a lest 
configuration file including a series of test inquiries for a 
web site to be tested, initiating a HTTP communication to 
form a connection with the web site, and repetitively com- 
municating with the web site to test for a variety of errors. 
The repetitive communication preferably includes receiving 
HTML from the web site, analyzing the HTML for errors 
and storing results in the database, and formulating a new 
HTTP communication based upon the received HTML and 
the test configuration file. Preferably, the test configuration 
file is created by sending HTML comprising a blank testing 
form to a web browser, receiving HTTP from the web 
browser as a submission from the HTML testing form, and 
developing the test configuration file from the HTTP. 

24 Claims, 18 Drawing Sheets 
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Is your business-critical web site up right now? 
How do you know? 

If you had SiteScope and SiteSeer, not only would you know if your web site was up, you would be 
confident that you would be notified immediately if a problem did occur. SiteScope allows you to 
monitor everything from memory and disk space usage to URL and service availability. Error 
notification is available via e-mail, pager, and SNMP traps. SiteScope can also run recovery scripts to 
correct common problems. The SiteSeer service monitors your site remotely, letting you know of 
problems your visitors are experiencing, but you're unaware of. Together, SiteScope and SiteSeer 
help ensure that your site is up and running smoothly 24 hours a day, 7 days a week. 



SiteScope Software 



Version 3.0 Available Now! 

• 24 hour monitoring of web pages, forms, 
servers, and more... 

• Immediate error notification via e-mail, 
pager, or SNMP trap 

a Escalation of notification 

• Automatic error recovery 

• Ability to integrate with enterprise 
solutions 

Review SiteScope 3.0's release notes! 



SiteSeer Service 

E-commerce Transaction Testing 
Available! 

• Remote web site monitoring 24 hours a day 

• Support for secure URLs 

• Verification of password protected pages 

• String matching on both page content and 
error messages 



try it || buy it|| more info 



try it || buy it || more info 



Fresh News... 

►PCToday raves about SiteScope in the work place in its February issue. Full Story 

►DIGEX chooses SiteScope to monitor the world's largest dedicated server web site management 
facilities. Full Storv 

►SiteScope receives a Five Palm Tree rating from Beverly Hills Software. Full Storv 

"They've found an important niche from a web server 
administrator perspective... It's expandable and customizable; 

it's a fantastic product" 
-- Brad Hogan, Newbridge Networks. More customer quotes 
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Contact Us 

© Copyright 1 998 by Freshwater Software, Inc., Boulder, Colorado. All rights reserved 
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Search Us 



To search the document on the Freshwater Software™ Web site, enter the words you want to search 
for below. 0 



Search For i John 



[ Find Document -J *""**^ 

By default, only documents containing all the words are found. To find documents containing any of 
the words, separate them with "OR". For example, 'mail OR support to find any documents 
containing either of these words. 
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Search Results 



Searching for: John 



Who We Are (Thu 5 Feb 98) 
"john" 5 (John) 
SiteScopeFAQ(Wed 3 Jun 98) 
"john" 4 (John) 

Freshwater Software Contact Information (ThuSFeb 98) 
"John" 3 (John) 

Chief Technical Officer (Tue 26 May 98) 
"john M 2(John) 

Escalation Rules (Fri 9 Jan 98) 
"john" 2 (John) 

DIGEX Selects Freshwater Software s SiteScope to Enhance Reliability for its Web Site 
Management Customers (Thu 5 Feb 98) 
"john" 1 (John) 

MANAGEMENT BIOGRAPHIES (Thu 5 Feb 98) 
"john" 1 (John) 

Freshwater Software'™ Press Release (Fri 30 May 97) 
"john" 1 (John) 

THe FRESHWATER SOFTWARE PRESS ROOM (Thu 5 Feb 98) 
"john" 1 (John) 

Freshwater Software 1 ^ Press Release (Thu 5 Feb 98) 
"john" 1 (John) 



HOME ] ORDER [ PRODUCTS | SUPPORT 1 SEARQI | ABOUT US 
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nri Fr«3l»>\3ter 

Software 
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© Copyright 1998 by Freshwater Software, Inc., Boulder, Colorado. All rights reserved 
This searchable archive was implemented with the ICE search engine 
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example.mg 

_id=l 

_class=URLSequenceMonitor 

_name=URL Transaction: http://www.freshtech.com 
_description= 

ljnonitorDescription=Example transaction of 5 steps 

_frequency=600 

_timeout=60 

_error?requency=120 

_disabled=false 

_verifyError=false 

_proxy= 

j?roxyusername= 

_proxypassword= 

_schedule= 

'_referenceTypel=url 

_referencel=http: //www. freshtech.com 

_errorContentl=Not Found 

_usernamel= 

_passwordl= . 

_contentl= 

*_referenceType2=link 
_re f er ence2 = SEARCH 
_errorContent2= 
_username2= 
_password2= 
^_content2= 
'_referenceType3=form 
_reference3=Find Documents 
_postData3=KEYWORDS=John 
_content3=0f ficer 
_errorContent3= 
_username3= 
password3= 
'_referenceType4=url 

_ref erence4=http : / /www. macromedia . com/index . html 

„errorContent4= 

_username4= 

_password4=- 

^_content4= 

'_referenceType5=frame 

_reference5=mm_nav 

_errorContent5= 

_username5= 

_password5= 

fc _content5= 
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METHOD AND APPARATUS FOR TESTING loaded web page. An example of prior art testing software 

WEB SITES includes the WhatsUp™ software of IpSwitch, Inc. of 

Lexington, Mass. This software is capable of testing only a 

BACKGROUND OF THE INVENTION single web page. 

This invention relates generally to wide area networks, 5 Unfortunately, the simple downloading of web pages 

and more particularly to the testing of web sites hosted by with perhaps, a cursory examination of the HTML ts often 

web servers coupled to a TCP/IP protocol network. insufficient to determine all the errors that a user might 

^, , , , , , ... , encounter when actually interacting with those web pages. 

• Tbe u Inler ^ J haS ; ° f v', 6 ' beC ,° ™1kTp° US ' Th ! lDte u™u is due, in part, to the complex interactivity permitted 

is a robust, Wide Area Network (WAN) of networks which 10 under the HTML standards, and is due, in part, to the fact 

permits communication among computers, network^ and ^ intcractions with web pages are "dynamic" in that 

other digital devtces which adhere to a standard TCP/IP m ch from S6Ssion , Q wouW lhcrefore 

protocol. One of the most popular ways of communicating be desirable , 0 hav( , a mcthod fof , esli a web ^ which 

over the intersite is through a web site which is hosted on caQ |es| mM , 6 fcatures q[ wcb and which ca[) 

a suitable digital processing machine such as a personal 15 handl( . d ic intcractions ^ the web site . 
computer, workstation, etc. Users or clients use, for 

example, their personal computers to communicate with a SUMMARY OF THE INVENTION 

web site via a browser program or, simply, "browser." The ^ .... , , 

most commonly used browsers are the Navigator™ from ^ P' esent inventl0n P/ovdes a method, apparatus and 

Netscape Communications, Inc., and the Internet Explorer™ 20 s y ste u m f ° r . ,estln 8. a w « b slt ":J^ ln ^ Dt, °" .Indies a 

r_ w- ft . number of interactive modes with the web site being tested, 

from Microsoft, Inc. . 6 ' 

, „ . , . ,. and handles dynamic interactions with the web site. 

It has become increasing simple for companies and indi- a. j * * u •* ■ j -.u*u 

. . . t t . . u t-u « « ^ „ ~f A method for testing a web site in accordance with the 

viduals to create their own web sites. There are a number of . r . . . . n m 

. . . , u . , . present invention formulates a test configuration file corn- 
corn merci ally available packages which generate the neces- * .. . p » . . - L . 

j irrn rr j . « u » u • u u prising a series of tes t inquiries for a web site, initiates an 

sary HTML code to create "web pages* which can be 25 ij,™? • *• . r u u 

■ j j i . . j ♦ .u i . 4 o HTTP communication to form a connection with the web 

uploaded to web servers connected to the Internet. Connec- . , . . L . , . 

....... «i . . A . . , site, and repetitively communicates with the web site. More 

tions to the Internet and web server hosts are often provided * . , *\. r u , .... , . , ... t , 

, , t * * ■ - n ■j„/icd> particularly, the method repetitively communicates with the 

by a company known as an Internet Service Provider (ISP). . • • «™t r a. u % i • 

^ r ^ . web site by receiving HTML from the web site, analyzing 

Since web pages are, essentially, programs wntten in the HTML for errors and storing the results in the database, and 

HTML language, it is possible that one or more web pages ^ ^ f ormu i at ing a new HTTP communication to the web 

of a web site contains errors. These errors may only show up site based upon the received HTML and the test configura- 

intermittently since much of the interaction with the web site ^ Qn 

can be dynamic, i.e. it can change from session to session. ™ .. c c , # . , , a C1 

XT.', ', . c . , . The operation of formulating a test configuration file 

Therefore, the need has arisen tor some method to test web e U1 . , , imxi -° U i i 

35 preferably includes sending HTML comprising a blank 

sites or errors. testing form to a web browser, receiving HTTP from the web 

In FIG. 1, a system 10 for testing a web site includes a browser as a submission from the testing form and devel- 

TCP/1P protocol network 12, such as the Internet, a web oping the ^ configuration file from the HTTP received 

server 14 coupled to the Internet 12 by an ISP 16, any from tne web browser. In this fashion, a standard web 

number of user or client machines such as client machines ^ browser can be used as the interface between the test 

18A, 18B, 18C, etc. coupled to the Internet 12 by ISP's 30 operator and the testing software. Preferably, the web 

20A, 20B, 20C, etc., and a testing computer 22 coupled to browser can also be used to edit test configuration filed that 

the Internet 12 by an ISP 24. has a i reao -y been developed. 

In the prior art, software running on the testing computer ^ apparatus for testing a web site includes a computer 

22 connects with a web site 26 hosted by the web server 14 45 having memory and a processor, and a monitor object 

through the Internet 12 and attempts to download web pages. resigning at least partially in the memory and executed by 

Upon a failure to download a web page, the testing computer me processor. The monitor object includes an initiator to 

22 running this prior art software detects an error. establish an HTTP communication between the monitor 

It should be noted that a depiction of FIG. 1 is logical in object and a web site and a repetitive communicator which 

nature, and may be implemented in a variety of fashions. For 50 repeatedly receives HTML from the web server, analyses the 

example, the testing computer 22 and the web server 14 can HTML for errors and stores the results in a database, and 

be the same machine. As another example, any of the client formulates a new HTTP communication based on the 

machines 18 A, 18B, 18C, etc., or the testing computer 22, or received HTML. Preferably, the apparatus also includes a 

the web server 14 can be connected into the Internet 12 in scheduler residing at least partially in the memory and 

other fashions, such as into the "backbone" of the Internet. 55 executed by the processor which is operative to invoke the 

Further the Internet is only one example of a network 12 monitor object, determine whether the monitor object is 

implementing a TCP/IP protocol. Other examples of TCP/IP scheduled to be run, and run the monitor object as scheduled 

protocol networks include intranets and extranets, as will be to initiate the HTTP communication to form a connection 

appreciated by those skilled in the art. with the web site by repetitively communicating with the 

The testing computers 22 of the prior art include testing 60 weD site, 

software which simulate browser software to the extent that A system for testing a web site includes a TCP/IP protocol 

they can download web pages. The successful downloading network, a web server connected to the TCP/IP protocol 

of a web page in the prior art was usually considered network and hosting a web site, and a testing computer 

sufficient to determine thai that web page was error free. In having memory and a processor that is connected to the 

some instances, prior art testing computers 22 may examine 65 TCP/IP protocol network. The testing computer is operative 

or "parse" the HTML of the downloaded web page to make to formulate a test configuration file stored in the memory 

further determination whether there is an error in the down- including a series of test inquiries for a web site to be tested, 
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to initiate an HTTP communication to form a connection tion. More particularly, an apparatus 22' of the present 
with the web site and to repetitively communicate with the invention includes a computer 28, a keyboard 30, a video 
web site by receiving HTML from the web site, analyzing monitor 32, and preferably a mouse 34 or some other form 
the HTML for errors, and storing the results in a database, of pointing device. As will be appreciated by those skilled in 
and formulating a new HTTP communication based upon 5 the art, the computer 28 includes a microprocessor 36 and 
the received HTML and test configuration file. computer readable memory 38 which support computer 
An advantage of the present invention is that a web site implemented processes. Displayed on the screen 40 of the 
can be thoroughly tested in a variety of interactive modes. monitor 32 is a web browser window 42 displaying a web 
Also, the present invention allows for the testing of change- page 44 of the present invention. The computer 28 and the 
able or "dynamic" features of the web site. Inconsequence, 1° peripherals 30, 34, and 40 comprise standard personal 
the present invention facilitates the thorough testing of web computer and workstation equipment, available from a van- 
sites for errors and generates reports which aids in the ety of sources 

correction of the detected errors. Other advantages include FIG. 2A illustrates the relationship of tester software 46 of 

the capability of immediately providing a notification of any the present invention to web browser software 48 and the 

problems, and the reporting of performance and service 15 Internet 12. More particularly, the tester 46 communicates 

levels. directly with the Internet 12 through ISP 24. That is, the 

These and other advantages of the present invention will tester 46 can pass HTTP to the Internet 12 and receive 

become apparent to those skilled in the art upon a reading of HTTP/HTML from the Internet 12 without the need for an 

the following descriptions of the invention and a study of the intermediary of a web browser. The tester 46 communicates 

several figures of the drawing. 20 independently with the web browser 48 by sending HTTP to 

the web browser 48 and by receiving HTTP/HTML from the 

BRIEF DESCRIPTION OF THE DRAWINGS web browser 48. 

FIG. 1 is an illustration of a system including the Internet, As suggested in FIG. 2A, the tester 46 and the web 

a number of client machines, a web server, and a testing browser 48 can be implemented on the same computer 

computer; 25 apparatus ("machine") or on separate computer apparatus. 

FIG, 2 is a pictorial representation of a testing computer The case where the tester and the web browser have been 

22' of the present invention; implemented on the same computer apparatus 22', they both 

FIG. 2A is a pictorial representation of testing software can operate under the same operating system, i.e. OS1-OS2. 

implementing the present invention, as well as standard web However, in the instance where the tester 46 and the web 

browser software* browser 48 are implemented on different computer 

FIG. 2B is a flow-diagram illustrating the overall opera- apparatus, there is no reason why the two can't be supported 

tion of the present invention; ° n different operating systems, i.e. OS1 might be different 

, , .,„•„ . . • rir-rw, from OS2. For example, the tester 48 may be implemented 

FIGS. 3A 3B, 3C 3D, and 3E illustrate a series of HTML under a a[ ^ { ^ ^ ^ under 

web pages that will be used as an example when explaining 35 Windows 95 ^ ^ web brQWSer ^ might be imple . 

the present invention, mented on another computer under a workstation operating 

FIGS. 4A-4C illustrate a blank form used to develop the system such as UNIX. 

testine configuration file of the present invention; _ a •« . . 

& 6 r In FIG. 2B, a flow-diagram illustrates various operations 

^ FIG. 5 is a illustration which helps an explain a HTML ^ of the tester 46. At a main menu 50, it is determined whether 

"form' ; me user wants l0 the web site tester or to analyze results 

FIG. 6 is an exemplary test configuration developed by 0 f prev ious web site tests. If it is determined that the user 

the process of the present invention from the web pages of wishes to analyze results, a "logging file" or "log file" is 

FIGS. 3A-3E; analyzed and results are displayed in an operation 52. 

FIG. 7 is a flow-diagram illustrating the "ANALYZE Statistical methods for analyzing data, and tabular and 

CONFIGURATION FILE ACTIVATION SCHEDULE" graphical methods for displaying data are well known to 

operation of FIG. 2B; those skilled in the art and will not be described here. If, on 

FIG. 8 is a flow-diagram of the "SEND HTTP TO WEB the other hand, it is determined from the main menu 50 that 

SITE AND RECEIVE HTTP/HTML" operation of FIG. 2B; the web site tester is to be run, an operation 52 analyzes a 

FIG. 8A is a flow-diagram detailing "FIND ALL FIELDS 50 test configuration file, as well as an activation schedule. The 

ON FORM WITH SUBMIT BUTTON" operation of FIG. 8; operation 52 has, as an input, a real-time clock 54 which can 

FIG. 8B is a flow-diagram illustrating the "TAKE SUP- P rovid f a ™J^ mc date 5 f and real-time hours minutes and 

PLIED POST DATA AND OVERWRITE VALUES" opera- seconds 58 ' ° ften > a rea time J dock f 54 P rcmdes °" e lon 8 

tion of FIG 8- and number that represents elapsed time from a given date and 

FIG. 9 is a' flow-diagram illustrating the "ANALYZE 55 5^!^^° ^ n ^ 1 S ri,bmiC,lly C0Dverted imo 

AND STORE RESULTS IN LOG FILE" operation of FIG. di£ houis^te. and seconds. 

2g If operation 52 detects that a new test configuration file is 

being requested via a web browser 42, a "blank form" is sent 

DETAILED DESCRIPTION OF THE j n the form of HTTP/HTML to the browser. After the blank 

PREFERRED EMBODIMENTS 6Q form has been filled in by a user of the browser, the process 

FIG. 1 illustrates a system for testing a web site, wherein, receives the information from the browser in an operation 

a testing computer 22 implements a testing process. The 62. This is returned in a form of HTTP, as will be appreciated 

differences in the system of the prior art and the system of by those skilled in the art. Then, operation 64 is used to 

the present invention is the software running on the testing create a new test configuration file, and process control is 

computer 22, or elsewhere in the system. 65 returned to operation 52. 

In FIG. 2 a computer apparatus 22' implements a process If, on the other hand, operation 52 determines that the user 

for testing a web site in accordance with the present inven- wishes to edit a test configuration file, a "Fig. Form" is sent 
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via HTTP/HTML to the browser in an operation 66. The edit 
information is received from the browser in operation 68 in 
the form of HTTP. An operation 70 then creates the edited 
test configuration file, and process control is returned to 
operation 52. 

When operation 52 determines that it is time to execute 
the configuration file by analyzing the activation schedule 
and by comparing the activation schedule to information 
received from the real-time clock 54, process control is 
turned over to operation 72 to determine whether the execu- 
tion of the configuration file is completed. If so, process 
control returns to operation 52. If not, then operation 74 
sends HTTP to the web site and receives, in turn, HTTP/ 
HTML from the web site that is being tested. The HTTP/ 
HTML is analyzed and the results are stored in a log file. In 
addition, the analysis of operation 76 determines the nature 
of the next HTTP transmission to the web site in operation 
74. This analysis will be described in greater detail below. 

In FIGS. 3A-3E, a number of exemplary web pages are 
presented to describe the process of the present invention. It 
should be noted this is just one example of a virtually 
unlimited number of web pages and web page combinations 
which can be tested by the process of the present invention. 

In FIG. 3Aan illustrated web page 78 is the "home page" 
of Freshwater Software, Inc. Among other features, it 
includes a series of buttons 80 which form "links" to other 
web pages. In particular, a button 82 makes a link to a 
"search" web page. 

In FIG. 3B, the search web page 84 that was accessed by 
the button 82 of the home wet) page 78 includes a number 
of features including a data entry field 86 and a submit 
button 88. As seen in this example, the data entry field 86 
includes the string "John", such that instances of the word 
"John" on the Freshwater Software web site will be found 
after the submit button 88 is activated. As is well known to 
users of web browsers, buttons such as buttons 82 and 88 are 
activated with a pointer device such as the mouse 34, or by 
pressing the "ENTER" key on a keyboard 30. 

FIG. 3C shows a results web page 90 listing all of the 
instances including the string "John" that is on the Fresh- 
water site. 

FIG. 3D illustrates a web page 92 for another company, 
Macromedia. A portion 94 of the web page 92 is a separate 
web page 94 as illustrated in FIG. 3E. This is an example of 
"framing" wherein a web page is embedded within another 
web page. Such "nesting" or "embedding" can occur to 
multiple levels, i.e. frames within frames within frames. 

FIGS. 4A, 4B, 4C illustrate the web page 44 of FIG. 2 in 
greater detail. More particularly, these are the web pages 
used to create a "monitor object" which will be used to test 
and gather data concerning the operation of a web site under 
test. It should be noted that multiple monitors monitoring 
multiple web sites or monitoring a single web site in 
multiple fashions can be operating simultaneously. This is a 
well-known function of an object oriented programming and 
of a multi-tasking computer system. However, the following 
description will be in the context of creating a specific 
monitor an object which will test the functionality of the 
pages of FIGS. 3A-3E. 

As noted in FIG, 4A, the "Add URL Transaction Monitor" 
refers to a number of steps. This particular web page 96 is 
created by activating the "SiteScope" button 96 of the button 
bar 98. Another button 100 labeled "Reports" can be used to 
generate test result reports. Therefore, it will be appreciated 
that the process 46 of FIG. 2B can utilize a web browser 
window 42 for user interface purposes. 
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Under stepl type, a pull down menu 102 is provided 
which has the entry of URL. This is because the stepl 
reference 104 must always be a URL to act as a starting point 
for the process. The URL can be the URL of a web site home 

5 page, or of any other web page. It is merely a starting point 
for the test. The step2 type pull down window 106 is a "link" 
to a button labeled "Search" as in a step2 reference 108. 
Step3 type is selected to be "Form" in pull down menu 110, 
while the entry field 112 of step3 reference is left blank, 

io Step4 type in pull down window 114 is "URL", while the 
URL in field 116 is input as "http:/ www.freshtech.com." An 
update box 118 is set at every 10 minutes an optional title 
that would appear in the monitor table from the field 120 is 
left blank. A button 122 is activated if the monitor is to be 

15 created from this data. 

In FIG. 4B, the web page 96 further includes a "disable" 
box 124 to temporarily disable the monitor sampling and 
alerting. Next, a stepl POST data field 126 has, as entries, 
"name=abc" and "address=def \ The data in the POST data 

20 field 126 is used to fill in field parameters. A stepl match 
content field 128 includes the string "Thank you for entering 
your name." A stepl "error if match" field 130 includes the 
string "invalid entry." A stepl authorization user name 132 
includes a user name Paul, and stepl password field 134 

25 including a password "secret." Step2 POST data and step3 
POST data can likewise be entered. 

In FIG. 4C, the end of the step3 POST data and the step4 
POST data can be seen on the remainder of page 96. Below 
the words "Verify Error" a different portion of the web page 

30 96 is presented which is generic to other parts of the 
software of the present invention. More particularly, pull 
down menu 136 permits the update period of minutes, hours, 
days, etc. to be selected while entry filed 138 indicates the 
number of seconds, minutes, hours, etc. The update indicates 

35 the amount of time between checks whenever the status of 
the monitor indicates a problem. 

A pull down menu 140 indicates a schedule for the 
monitor to be enabled. In this instance, it is selected to every 
day, all day. Alternatively, it could be scheduled for Monday 

40 through Friday, evenings only, etc. Custom schedules can be 
created by hitting the "edit schedule" button 142. 

Fields 144 and 146 are optional fields which allows a user 
to enter monitor and report descriptions, respectively. A field 

45 148 permits a time out period in seconds, to wait for the 
entire sequence to complete. That is, if a monitor session 
takes more than the time out period, an error or warning will 
be indicated. 

The present invention also permits the use of a proxy 

50 server. The fields associated with an optional proxy server 
are shown at 150. In the field 150A, the HTTP proxy is 
entered. In field 150B, the proxy server user name is entered. 
In field 150C, the proxy server password is used. 
A pull down menu 152 is used for the list order for the 

55 monitors. As noted previously, any number of monitor 
objects can be created to test multiple web sites or to test the 
same web site in multiple ways. The "list order" indicates 
where on a list of monitor objects the current monitor object 
is to be added. In this instance, the list order is "last". Other 

60 list orders include "first", "middle", etc. 

The web page 96 also includes an "Error" pull down menu 
154 and a "Warning" pull down menu 156. In this instance, 
an error is set if the status is not equal to 200, which is a 
default, and a warning will occur if status is equal to -994, 

65 which is also a default. A status 200 means "good" and is 
associated with the status field of an HTTP request. The 
-994 default on the warning is an arbitrary internal coding 
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indicating a software problem. For example, if the software 
takes more than 10 seconds to respond, a status -994 may 
be provided. 

In FIG, 5, a form 158 is displayed to illustrate some of the 
concepts of the present invention. The form includes a first 
label 160 "name:" and a second label 162 called "address:". 
Associated with the labels 160 and 162 are entry fields 164 
and 166, respectively. Also associated with the form is a 
"submit" button 168. The form 158 is as it may appear 
within a browser window. The HTML which creates the 
form 158 in the browser window is shown generally at 170. 
The use of HTML 170 to create a form 158 in a browser 
window is well known to those skilled in the art, 

FIG. 6 illustrates a test configuration file 172 produced by 
filling out the web page 96 and hitting the "Add" monitor 
button 122. The test configuration file includes a number of 
labels or "tags" followed by an equal sign and either a 
parameter or a blank field. Where the field is blank, the tag 
is ignored and default values are used, if any. 

As noted, the monitor description at 174 is an example of 
a five step transaction. Other tags such as frequency, time 
out, error frequency, etc. are filed in, while a number of tags 
are left blank. For example, since a proxy server is not being 
used, the tags for the proxy server are all left blank. The tags 
and parameters for step 1 are shown at 176. The "reference 
type 1" tag is associated with the parameter "URL". The tag 
reference 1 is associated with parameter http:/ 
www.freshtech.com. Steps 2, 3, 4, and 5 are found at 178, 
180, 182, and 184, respectively. It should be noted that the 
step2 type is "blank", the step3 type is "form", the step4 type 
is "URL" and the stepS type is "frame". Therefore, this 
example of a test configuration file 172 illustrates four of the 
main types of features which can be verified and tested by 
the process of the present invention. 

In FIG. 7, a flow diagram of the operation 52 in FIG. 2B 
is shown in greater detail. The process 52 begins at 186, and 
in operation 188, it is determined whether a new or edited 
configuration file has been created as set forth above. If so, 
a "monitor object" is created from the configuration file for 
one time execution in an operation 190. The creation and use 
of software objects are well known to those skilled in the art. 
Then, in an operation 192, the monitor object is "invoked". 
By invoked it is meant to end that the monitor object is 
activated for use. In an operation 194, it is determined 
whether the monitor object is scheduled to run with regards 
to repeat time. If it is not, process control is returned to 
operationl88. If it is, it is determined in operation 196 
whether the monitor object is scheduled to run by date and 
time. If not, process control is again returned to operation 
188. If the monitor object is scheduled to run with regards 
to both repeat time and by date and by time, then the monitor 
is "run" in an operation 198. By "run" it is meant that the 
monitor object is caused to perform the process of the 
present invention to test a web site. 

In FIG. 8, a flow diagram illustrates the process 74 of FIG. 
2B in greater detail. The process 74 begins at 200, and in an 
operation 202, the "next step" and cookie is retrieved. The 
next step is the next test step as described above. The 
"cookie" is a data file received from the web site being tested 
that includes information concerning user preferences, user 
history, etc. An operation 204 determines whether the next 
step is a null and if so, the process is completed at 206. If 
there is a next step, operation208 determines the step type, 
as described below. 

If operation 208 determines that the next step type is 
"URL" a step 210 sends an HTTP request for the URL and 



•8,157 

8 

the cookie associated with that URL. Process control is then 
turned over to an operation 211 which takes measures based 
on the HTTP request and response, analyzes received HTML 
for expected content and errors using methods such as 
5 matching against string valves, regular expressions, and 
calculated valves and stores them in a database. Error 
analysis and matching methods are well known to those 
skilled in the art. Process control then returns to operation 
202. 

10 If operation 208 determines that the step type is a "link", 
an operation 212 searches the current HTML for a "link" tag 
having the specified content. In operation214 determines 
whether the appropriate "link" has been found and, if not, an 
error message 216 is generated the process aborts at 218. If 

15 the link is found by the operation 214, an operation 220 
sends an HTTP request for the URL and the cookie and 
process control reverts to operation 211. 

If operation208 determines that the step type is "form", an 
operation 222 searches the current HTML for a "submit" 

20 button with the specified content. An operation 224 deter- 
mines whether the appropriate "submit" button has been 
found, and if not, operation 228 determines that there is an 
error and the process 76 aborts at 229. If the appropriate 
submit button is found by operation 224, an operation 230 

25 finds all fields on the form with the submit button and 
determines or calculates the default values for this field. An 
operation 232 then takes the supplied post data and overlays 
the default values such that all appropriate fields have been 
filled. An operation 234 then sends an HTTP request "post" 

30 plus the cookie and process control returns to 211. 

If operation 208 determines that the step type "frame" an 
operation 236 searches the current HTML for a "frame" tag. 
An operation 238 determines whether the appropriate frame 

35 tag has been found. If not, an operation 240 indicates an 
error and the process 76 aborts at 241. If the appropriate 
frame tag has been found by operation 238, an operation 242 
sends an HTTP request for the URL and the cookie. Process 
control then returns to operation 211. 

40 In FIG. 8A, the operation 230 of FIG. 8 is described in 
greater detail. The process 230 begins at 243 and, in a 
operation 244, all form input elements are determined. If a 
form input element is not recognized, then the process is 
complete at 260. If operation 244 finds a radio button input 

45 element, operation 248 picks the first radio button for the 
value. If the operation 244 finds a check-box for the input 
element, an operation250 determines whether the box is 
checked. If it is, an operation 252 sets the value, and if it is 
not an operation 254 indicates that there is no value. If an 

50 operation 244 finds a text input element, an operation 256 
sets the value to the default string. If operation 244 finds 
pop -up menu, an operation 258 picks the default as the 
value. The process 230 is then complete at 260. 

In FIG. 8B, the process 232 of FIG. 8 is illustrated in 

55 greater detail. The process 232 begins at 262 and, in an 
operation 264, values from operation 230 (see FIG. 8) are 
written into the name tags. For example, namel is set to an 
arbitrary or default valuel, name2 is set to an arbitrary or 
default value2, etc. Next, in an operation 266, the "post data" 

60 entered by the user is used to override the appropriate name 
tags. In this instance, the name tag "name 2" is set to the data 
"Paul". The final, merged data is illustrated at 268 and the 
process is completed at 270. 

In FIG. 9, the process 76 of FIG. 2B is illustrated in 

65 greater detail. The process 76 begins at 272, and in an 
operation 274, it is determined whether there are any aborts 
that occurred within the process 74, If there were, an 
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operation 276 displays and logs a an error message. If there 
were not any aborts, then the process 74 terminated normally 
in an operation 278, and the process displays and logs the 
URL and the size of each web page and the time it took to 
download into a log file. An operation 280 displays and logs 
the total time for the download in an operation 280, In an 
operation 281 it is determined whether there are any alerts. 
If there were, an operation 282 activates a process. The 
process would commonly notify a person using a mecha- 
nism such as e-mail or pager or cause a user-specified 
process to start. The process is then complete at 283. 

While this invention has been described in terms of 
several preferred embodiments, it is contemplated that 
alternatives, modifications, permutations and equivalents 
thereof will become apparent to those skilled in the art upon 
a reading of the specification and study of the drawings. It 
is therefore intended that the following appended claims 
include all such alternatives, modifications, permutations 
and equivalents as fall within the true spirit and scope of the 
present invention. 

What is claimed is: 

1. A method for testing a web site comprising: 
formulating a test configuration file comprising a series of 

test inquiries for a web site to be tested; 
initiating an HTTP communication to form a connection 

with said web site; and 
repetitively communicating with said web site by: 
receiving HTML from said web site; 
analyzing said HTML for errors and storing results in 

a database; and 
formulating a new HTTP communication based upon 
said received HTML and said test configuration file. 

2. A method for testing a web site as recited in claim 1 
wherein said method is implemented as a computer imple- 
mented process. 

3. A method for testing a web site as recited in claim 2 
wherein said computer implemented process is capable of 
direct HTTP and HTML communication with said web site. 

4. A method for testing a web site as recited in claim 3 
wherein said direct HTTP and HTML communication is 
over a TCP/IP protocol network. 

5. A method for testing a web site as recited in claim 1 
wherein said operation of formulating a test configuration 
file comprises: 

sending HTML comprising a blank testing form to a web 
browser; 

receiving HTTP from said web browser as a submission 

from said HTML testing form; and 
developing said test configuration file from said HTTP 

from said web browser. 

6. A method for testing a web site as recited in claim 5 
wherein said operation of formulating a test configuration 
file further comprises: 

developing a filled testing form from an existing test 

configuration file; 
sending HTML comprising said filled testing form to a 

web browser; 

receiving HTTP from said web browser as a submission 

from said HTML testing form; and 
updating said test configuration file from said HTTP from 

said web browser. 

7. A method for testing a web site as recited in claim 1 
wherein said test configuration file provides a plurality of 
tests selected from the group comprising a URL, a link, a 
form button, and a frame. 
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8. A method for testing a web site as recited in claim 7 
wherein said test configuration file includes comparison data 
used to compare HTML received from said web server with 
a predetermined criteria. 
5 9. A method for testing a web site as recited in claim 1 
further comprising analyzing said database and providing a 
display of the results of said web site testing. 

10. A method for testing a web site as recited in claim 1 
further comprising analyzing said database and sending 

10 alerts of the results of said web site testing. 

11. A method for testing a web site as recited in claim 1 
wherein said test configuration file comprises an automatic 
scheduling for testing said web site. 

12. A method for testing a web site as recited in claim 1 
is wherein said automatic scheduling includes scheduling win- 
dow information, and test repetition information. 

13. A method for testing a web site as recited in claim 1 
further comprising: 

creating a monitor object from said test configuration file; 
20 and 

repetitively testing said web site by 
evoking said monitor object; 

determining whether said monitor object is scheduled to 
25 be run; and 

running said monitor object when it is scheduled to be run 
to initiate said HTTP communication to form a con- 
nection with said web site and by repetitively commu- 
nicating with said web site. 
30 14. A computer readable media including the program 
instructions and data for implementing the method of claim 
1. 

15. An apparatus for testing a web site comprising: 
a computer having memory and a processor; 

35 a monitor object residing at least partially in said memory 
and executed by said processor, said monitor object 
including 

means for initiating an HTTP communication to form a 
connection with a web site; and 

40 

means for repetitively communicating with said web site 
by 

receiving HTML from said web server; 
analyzing said HTML for errors and storing results in 
45 a database; and 

formulating a new HTTP communication based upon 
said received HTML. 

16. An apparatus for testing a web site as recited in claim 

15 further comprising: 

50 a scheduler operative to 

invoke said monitor object; 

determine whether said monitor object is scheduled to 
be run; and 

running said monitor object when it is scheduled to be 
55 run to initiate said HTTP communication to form a 

connection with said web site and by repetitively 
communicating with said web site. 

17. An apparatus for testing a web site as recited in claim 

16 further comprising: means for creating said monitor 
60 object from a test configuration file. 

18. An apparatus for testing a web site as recited in claim 

17 further comprising: means for creating said test configu- 
ration file by communication with a web browser. 

19. A system for testing a web site comprising: 
65 a TCP/IP protocol network; 

a web server connected to said TCP/IP protocol network 
and hosting a web site; 
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a testing computer connected to said TCP/IP protocol 
network, said testing computer having memory and a 
processor, said testing computer being operative to 
formulate a test configuration file stored in said 
memory comprising a series of test inquiries for a web 5 
site to be tested, to initiate an HTTP communication to 
form a connection with said web site, and to repeti- 
tively communicate with said web site by receiving 
HTML from said web site; analyzing said HTML for 
errors and storing results in a database; and formulating 10 
a new HTTP communication based upon said received 
HTML and said test configuration file. 

20. A system for testing a web site as recited in claim 19 
wherein said testing computer includes a monitor object 
residing at least partially in said memory and executed by 15 
said processor. 

21. A system for testing a web site as recited in claim 20 
wherein said testing computer includes a scheduler operative 
to invoke said monitor object, determine whether said moni- 
tor object is scheduled to be run; and running said monitor 20 
object when it is scheduled to be run to initiate said HTTP 
communication to form a connection with said web site and 
by repetitively communicating with said web site. 

22. An apparatus for testing a web site comprising: 
computer means including 25 

means for formulating a test configuration file com- 
prising a series of test inquiries for a web site to be 
tested; 

means for initiating an HTTP communication to form 
a connection with said web site; and 30 

means for repetitively communicating with said web 
site by: 



receiving HTML from said web site; 

analyzing said HTML for errors and storing results in 

a database; and 
formulating a new HTTP communication based upon 

said received HTML and said test configuration 

file; and 

connecting means for connecting said computer means to 
a TCP/IP network through which said web site can be 
accessed. 

23. An apparatus for testing a web site as recited in claim 

22 wherein said means for formulating a test configuration 
file comprises: 

means for sending HTML comprising a blank testing form 

to a web browser; 
means for receiving HTTP from said web browser as a 

submission from said HTML testing form; and 
means for developing said test configuration file from said 

HTTP from said web browser. 

24. An apparatus for testing a web site as recited in claim 

23 wherein said means for formulating a test configuration 
file further comprises: 

means for developing a filled testing form from an exist- 
ing test configuration file; 

means for sending HTML comprising said filled testing 
form to a web browser; 

means for receiving HTTP from said web browser as a 
submission from said HTML testing form; and 

means for updating said test configuration file from said 
HTTP from said web browser. 



05/14/2004, EAST Version: 1.4.1 



